Automated Similarity Judgment Program

From Wikipedia, the free encyclopedia

Jump to navigationJump to search

The Automated Similarity Judgment Program (ASJP) is a collaborative project applying computational approaches to comparative linguistics using a database of word lists. The database is open access and consists of 40-item basic-vocabulary lists for well over half of the world's languages.[1] It is continuously being expanded. In addition to isolates and languages of demonstrated genealogical groups, the database includes pidgins, creoles, mixed languages, and constructed languages. Words of the database are transcribed into a simplified standard orthography (ASJPcode).[2] The database has been used to estimate dates at which language families have diverged into daughter languages by a method related to but still different from glottochronology,[3] to determine the homeland (Urheimat) of a proto-language,[4] to investigate sound symbolism,[5] to evaluate different phylogenetic methods,[6] and several other purposes.

Contents

1 History

1.1 Original goals

1.2 ASJP Consortium

1.3 Shorter word lists

1.4 Levenshtein Distance

2 Word list

3 ASJPcode

4 See also

5 References

6 Sources

7 External links

History[edit]

Original goals[edit]

ASJP was originally developed as a means for objectively evaluating the similarity of words with the same meaning from different languages, with the ultimate goal of classifying languages computationally, based on the lexical similarities observed. In the first ASJP paper[2] two semantically identical words from compared languages were judged similar if they showed at least two identical sound segments. Similarity between the two languages was calculated as a percentage of the total number of words compared that were judged as similar. This method was applied to 100-item word lists for 250 languages from language families including Austroasiatic, Indo-European, Mayan, and Muskogean.

ASJP Consortium[edit]

The ASJP Consortium, founded around 2008,[when?] came to involve around 25 professional linguists and other interested parties working as volunteer transcribers and/or extending aid to the project in other ways. The main driving force behind the founding of the consortium was Cecil H. Brown. Søren Wichmann is daily curator of the project. A third central member of the consortium is Eric W. Holman, who has created most of the software used in the project.

Shorter word lists[edit]

While word lists used were originally based on the 100-item Swadesh list, it was statistically determined that a subset of 40 of the 100 items produced just as good if not slightly better classificatory results than the whole list.[7] So subsequently word lists gathered contain only 40 items (or less, when attestations for some are lacking).

Levenshtein Distance[edit]

In papers published since 2008, ASJP has employed a similarity judgment program based on Levenshtein distance (LD). This approach was found to produce better classificatory results measured against expert opinion than the method used initially. LD is defined as the minimum number of successive changes necessary to convert one word into another, where each change is the insertion, deletion, or substitution of a symbol. Within the Levenshtein approach, differences in word length can be corrected for by dividing LD by the number of symbols of the longer of the two compared words. This produces normalized LD (LDN). An LDN divided (LDND) between the two languages is calculated by dividing the average LDN for all the word pairs involving the same meaning by the average LDN for all the word pairs involving different meanings. This second normalization is intended to correct for chance similarity.[8]

Word list[edit]

The ASJP uses the following 40-word list.[9] It is similar to the Swadesh–Yakhontov list, but has some differences.

Body parts

eye

ear

nose

tongue

tooth

hand

knee

blood

bone

breast (woman’s)

liver

skin

Animals and plants

louse

dog

fish (noun)

horn (animal part)

tree

leaf

People

person

name (noun)

Nature

sun

star

water

fire

stone

path

mountain

night (dark time)

Verbs and adjectives

drink (verb)

die

see

hear

come

new

full

Numerals and pronouns

one

two

I

you

we

ASJPcode[edit]

ASJP version from 2016 uses the following symbols to encode phonemes: p b f v m w 8 t d s z c n r l S Z C j T 5 y k g x N q X h 7 L 4 G ! i e E 3 a u o

They represent 7 vowels and 34 consonants, all found on the standard QWERTY keyboard.

Sounds represented by ASJPcode [2]

ASJPcode | Description | IPA
i | high front vowel, rounded and unrounded | i, ɪ, y, ʏ
e | mid front vowel, rounded and unrounded | e, ø
E | low front vowel, rounded and unrounded | a, æ, ɛ, ɶ, œ
3 | high and mid central vowel, rounded and unrounded | ɨ, ɘ, ə, ɜ, ʉ, ɵ, ɞ
a | low central vowel, unrounded | ɐ
u | high back vowel, rounded and unrounded | ɯ, u
o | mid and low back vowel, rounded and unrounded | ɤ, ʌ, ɑ, o, ɔ, ɒ
p | voiceless bilabial stop and fricative | p, ɸ
b | voiced bilabial stop and fricative | b, β
m | bilabial nasal | m
f | voiceless labiodental fricative | f
v | voiced labiodental fricative | v
8 | voiceless and voiced dental fricative | θ, ð
4 | dental nasal | n̪
t | voiceless alveolar stop | t
d | voiced alveolar stop | d
s | voiceless alveolar fricative | s
z | voiced alveolar fricative | z
c | voiceless and voiced alveolar affricate | ts, dz
n | voiceless and voiced alveolar nasal | n
S | voiceless postalveolar fricative | ʃ
Z | voiced postalveolar fricative | ʒ
C | voiceless palato-alveolar affricate | tʃ
j | voiced palato-alveolar affricate | dʒ
T | voiceless and voiced palatal stop | c, ɟ
5 | palatal nasal | ɲ
k | voiceless velar stop | k
g | voiced velar stop | g
x | voiceless and voiced velar fricative | x, ɣ
N | velar nasal | ŋ
q | voiceless uvular stop | q
G | voiced uvular stop | G
X | voiceless and voiced uvular fricative, voiceless and voiced pharyngeal fricative | χ, ʁ, ħ, ʕ
7 | voiceless glottal stop | ʔ
h | voiceless and voiced glottal fricative | h, ɦ
l | voiced alveolar lateral approximate | l
L | all other laterals | ʟ, ɭ, ʎ
w | voiced bilabial-velar approximant | w
y | palatal approximant | j
r | voiced apico-alveolar trill and all varieties of “r-sounds” | r, R, etc.
! | all varieties of “click-sounds” | ǃ, ǀ, ǁ, ǂ

See also[edit]

Lexicostatistics

Historical linguistics

References[edit]

^ Wichmann, Søren, André Müller, Annkathrin Wett, Viveka Velupillai, Julia Bischoffberger, Cecil H. Brown, Eric W. Holman, Sebastian Sauppe, Zarina Molochieva, Pamela Brown, Harald Hammarström, Oleg Belyaev, Johann-Mattis List, Dik Bakker, Dmitry Egorov, Matthias Urban, Robert Mailhammer, Agustina Carrizo, Matthew S. Dryer, Evgenia Korovina, David Beck, Helen Geyer, Patience Epps, Anthony Grant, and Pilar Valenzuela. 2013. The ASJP Database (version 16). http://asjp.clld.org/

^ a b c Brown, Cecil H., Eric W. Holman, Søren Wichmann, and Viveka Velupillai. 2008. Automated classification of the world's languages: A description of the method and preliminary results. STUF – Language Typology and Universals 61.4: 285-308.

^ Holman, Eric W., Cecil H. Brown, Søren Wichmann, André Müller, Viveka Velupillai, Harald Hammarström, Sebastian Sauppe, Hagen Jung, Dik Bakker, Pamela Brown, Oleg Belyaev, Matthias Urban, Robert Mailhammer, Johann-Mattis List, and Dmitry Egorov. 2011. Automated dating of the world’s language families based on lexical similarity. Current Anthropology 52.6: 841-875.

^ Wichmann, Søren, André Müller, and Viveka Velupillai. 2010. Homelands of the world’s language families: A quantitative approach. Diachronica 27.2: 247-276.

^ Wichmann, Søren, Holman, Eric W., and Cecil H. Brown. 2010. Sound symbolism in basic vocabulary. Entropy 12.4: 844-858.

^ Pompei, Simone, Vittorio Loreto, and Francesca Tria. 2011. On the accuracy of language trees. PLoS ONE 6: e20109.

^ Holman, Eric W., Søren Wichmann, Cecil H. Brown, Viveka Velupillai, André Müller, and Dik Bakker. 2008. Explorations in automated language classification. Folia Linguistica 42.2: 331-354.

^ Wichmann, Søren, Eric W. Holman, Dik Bakker, and Cecil H. Brown. 2010. Evaluating linguistic distance measures. Physica A 389: 3632-3639 (doi:10.1016/j.physa.2010.05.011).

^ http://asjp.clld.org/static/Guidelines.pdf

Sources[edit]

[1]

Brown, Cecil H., et al. 2008. Automated Classification of the World's Languages: A Description of the Method and Preliminary Results. Language Typology and Universals 61(4). November 2008. doi:10.1524/stuf.2008.0026

External links[edit]

ASJP Database official home page

Retrieved from "https://en.wikipedia.org/w/index.php?title=Automated_Similarity_Judgment_Program&oldid=848986061"

Categories:

Organizations established in 2008

Comparative linguistics

Computational linguistics

Historical linguistics

Linguistics organizations

Hidden categories:

All articles with vague or ambiguous time

Vague or ambiguous time from June 2018

Navigation menu

Personal tools

Not logged in

Talk

Contributions

Create account

Log in

Namespaces

Article

Talk

Variants

Views

Read

Edit

View history

More

Search

Navigation

Main page

Contents

Featured content

Current events

Random article

Donate to Wikipedia

Wikipedia store

Interaction

Help

About Wikipedia

Community portal

Recent changes

Contact page

Tools

What links here

Related changes

Upload file

Special pages

Permanent link

Page information

Wikidata item

Cite this page

Print/export

Create a book

Download as PDF

Printable version

Languages

Deutsch

Français

Edit links

This page was last edited on 5 July 2018, at 18:07 (UTC).

Text is available under the Creative Commons Attribution-ShareAlike License; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy. Wikipedia® is a registered trademark of the Wikimedia Foundation, Inc., a non-profit organization.

Privacy policy

About Wikipedia

Disclaimers

Contact Wikipedia

Developers

Cookie statement

Mobile view